METHOD AND APPARATUS FOR RENDERING COLOR IMAGE ON DELTA- 
STRUCTURED DISPLAYS 

This application claims priority from Korean Patent Application No. 
5 2002-50308, filed August 24, 2002, the contents of which are incorporated 
herein by reference in their entirety. 

BACKGROUND OF THE INVENTION 

1 . Field of the Invention 

io The present invention relates to a method and apparatus for rendering 

a color image on a delta-structured display, and more particularly, to a method 
and apparatus for rendering an optimal color image on a delta-structured 
display apparatus, by using a sub-pixel rendering method with input images 
having different resolutions. 

15 2. Description of the Related Art 

In an image display apparatus, 3 sub-pixels, R, G, and B, are needed in 
order to express one pixel as the parts indicated by dotted lines in FIGS. 1 and 

2. Accordingly, in a display apparatus, by manipulating the sub-pixels 
individually, a horizontal resolution can increase three times theoretically in the 

20 stripe topology of FIG. 2, and in the delta structure of FIG. 1, a horizontal 
resolution can increase 1.5 times and a vertical resolution can increase two 
times, theoretically. Meanwhile, when an image of a high resolution is desired 
to be displayed on a display apparatus having a low resolution, a jagged pattern 
occurs on the boundary of fine characters such as an Italic letter, in an ordinary 

25 individual pixel rendering method. This can be reduced by sub-pixel rendering, 
that is, individual manipulation of sub-pixels. However, the sub-pixel rendering 
has a drawback that it generates a color fringe on the boundary of an image. 
The color fringe is generated by a sudden change in the brightness value 
recognized between neighboring sub-pixels. This color fringe can be frequently 

30 found in the rendering of a diagonal line in the stripe structure and, this can be 
found in the rendering of a straight line in the vertical direction in the delta 
structure. 
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Among the existing patents written from the sub-pixel rendering 
perspective of an image display apparatus having this characteristic, there is a 
method of and apparatus for displaying a multicolor image by International 
Business Machines Corporation, US5341153, June 1988, in which a pixel of an 

5 input image is divided into R, G, B sub-pixels and rendered individually such 
that the effect of resolution improvement can be expected. In this technology, 
in order to render each sub-pixel, the average values of neighboring pixels 
about different central pixels of the input image corresponding to respective 
locations are used. However, though this technology improves the resolution, 

10 blurring is serious because a sub-pixel is rendered by the average value of the 
neighboring pixels, and a color fringe may occur in a sudden brightness change. 
Accordingly, rendering sub-pixels considering the characteristic of human 
eyesight is needed instead of the simple average of neighboring pixels. 

When characters and graphics such as lines are desired to be rendered 

is in a digital display apparatus such as an LCD, aliasing occurs in the sub-pixel 
rendering method. In a method and apparatus for rendering sub-pixel anti- 
aliased graphics, by Agfa Corporation, US 6384839, September 1999, a 
method for reducing aliasing in a sub-pixel rendering method when such 
aliasing occurs is explained. In this technology, in order to determine the 

20 values of sub-pixels R, G, B, an LPF-filtered average value considering 
neighboring pixels of a corresponding location and the difference between the 
foreground and background are considered. This method is effective for a 
graphic image or characters in which the distinction between the foreground 
and the background is clear, but not appropriate to an image such as a natural 

25 image in which the distinction between the foreground and the background is 
not clear. Also, this method can be applied only to stripe topology color 
displays. 

As described above, in the prior art technology of sub-pixel rendering 
for displaying a high resolution image on a low resolution display apparatus, 
30 blurring or color fringe occurs on the boundary, and the technology can be 
applied only to limited situations. 
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SUMMARY OF THE INVENTION 
The present invention provides a method and apparatus for rendering a 
color image on a display apparatus, in which a pixel expressing an input image 
of an input image signal is formed with delta-structured sub-pixels, and for an 
5 ordinary image where the foreground and background are not divided, by using 
sub-pixel rendering on the delta-structured display apparatus, the resolution is 
improved and the color fringe occurring by the sub-pixel rendering is reduced 
such that a sub-pixel rendering method appropriate to the delta structure can be 
implemented. 

10 According to an aspect of the present invention, there is provided a 

method for rendering a color image on a display apparatus in which a pixel 
expressing an input image that is the image of an input image signal is formed 
with delta-structured sub-pixels, the method comprising: (a) forming a scaling 
filter which is used to make the resolution of the input image correspond to the 

is resolution of the display apparatus; (b) obtaining a representative value of a 
sub-pixel of the display apparatus corresponding to a consideration area which 
is an area processed by the scaling filter in the input image; and (c) rendering 
the filtered sub-pixel value on the display apparatus. 

For better result, the method comprising: (a) forming a scaling filter 

20 which is used to make the resolution of the input image correspond to the 
resolution of the display apparatus; (b) obtaining a representative value of a 
sub-pixel of the display apparatus corresponding to a consideration area which 
is an area processed by the scaling filter in the input image; (c) obtaining the 
value of the sub-pixel based on the difference of pixels in the consideration area 

25 in the input image; (d) performing gamma correction of the sub-pixel value so 
that the sub-pixel is appropriate to the display apparatus; and (e) rendering the 
gamma-adjusted sub-pixel value on the display apparatus. 

In the method, the step (a) comprises: (a1) calculating the ratio of 
resolutions between the input image and the display apparatus; (a2) 

30 determining the number of masks of a scaling filter, based on the cycle of 
alternation in the horizontal direction and in the vertical direction between the 
pixel of the input image calculated by using the resolution ratio obtained in the 
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step (a1) and the sub-pixel of the display apparatus having a delta structure; 
and (a3) taking centroids of sub-pixels corresponding to respective masks as 
the centers of the masks, and determining the coefficients of the masks in 
proportion to the size of the masks. 
5 In the method, in the masks of the step (a3) the shape depends on sub- 

pixel structuring. 

In the method, in the step (b) the representative value of the sub-pixel is 
obtained by giving a weighted value -based on the distance to the central 
location of the sub-pixel of the display apparatus, to the values of the pixels of 

10 the input image in the consideration area. 

In the method, in the step (c) the value of the output sub-pixel is 
rendered by considering the product of coefficients of a scaling filter which 
corresponds to input pixels corresponding to the location of the sub-pixel and 
the difference between the representative value of the output sub-pixel obtained 

15 in the step (b) and neighboring input pixels in a corresponding area. 

In the method, in the step (d) the value of the output sub-pixel is 
corrected based on the gamma value of individual components of the sub-pixel. 

According to another aspect of the present invention, there is provided 
an apparatus for rendering a color image on a display apparatus in which a 

20 pixel expressing an input image is formed with delta-structured sub-pixels, the 
apparatus comprising: a scaling filter forming unit which forms a scaling filter 
which is used to make the resolution of the input image correspond to the 
resolution of the display apparatus; a sub-pixel representative value extracting 
unit which obtains a representative value of a sub-pixel of the display apparatus 

25 corresponding to a consideration area which is an area processed by the 
scaling filter in the input image; a sub-pixel value adjusting unit which obtains 
the value of the sub-pixel based on the difference of pixels in the consideration 
area in the input image; a gamma correction unit which performs correction of 
the sub-pixel value so that the sub-pixel is appropriate to the display apparatus; 

30 and a rendering unit which renders the gamma-adjusted sub-pixel value on the 
display apparatus. 
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BRIEF DESCRIPTION OF THE DRAWINGS 
The above objects and advantages of the present invention will become 
more apparent by describing in detail preferred embodiments thereof with 
reference to the attached drawings in which: 
5 FIG. 1 is a diagram of the structure of RGB sub-pixels expressed as 

one pixel appearing on a delta-structured display; 

FIG. 2 is a diagram of the structure of RGB sub-pixels expressed as 
one pixel appearing on a stripe topology display; 

FIG. 3 is a flowchart of the steps performed by a method for rendering a 
io color image on a delta-structured display; 

FIG. 4 is a flowchart of the steps performed by a method for 
determining a mask coefficient of a scaling filter; 

FIG. 5 is the shape of an ordinary mask of a scaling filter determining 
the value of a sub-pixel in a delta structure; 
15 FIG. 6 is the shape of a mask of a scaling filter determining the value of 

a sub-pixel appropriate to a delta structure; 

FIG. 7 is a flowchart of the steps performed by a preferred embodiment 
of a method for rendering a color image on a display apparatus; and 

FIG. 8 is a block diagram of the structure of a preferred embodiment of 
20 an apparatus for rendering a color image on a delta-structured display 
apparatus according to the present invention. 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 
FIG. 3 is a flowchart of the steps performed by a method for rendering a 
25 color image on a delta-structured display and shows a method for rendering a 
high resolution color image in a low resolution delta-structure display apparatus 
through sub-pixel rendering according to the present invention. 

In the method for rendering a color image on a delta-structured display 
apparatus according to the present invention, first, a scaling filter appropriate to 
30 an output display apparatus is formed for an input image in step 301 . 

Secondly, a representative value of an output sub-pixel for a 
consideration area of the input image is obtained in step 302. 
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Thirdly, the value of a sub-pixel considering the difference between 
corresponding pixels of the input image is obtained in step 303. 

Fourthly, gamma correction appropriate to a display apparatus on which 
the value of a sub-pixel is rendered is performed in step 304, and fifthly, the 
5 value of the sub-pixel is rendered on the display apparatus in step 305. 

The steps can be implemented by software in a computer system or as 
hardware in a display apparatus. 

Each of the steps will now be explained in more detail. 

First, in the step 301, resolution adjustment between the input image 
10 and a display apparatus is carried out through the process shown in FIG. 4. 
That is, the number of scaling filters and coefficients for determining the output 
value of a sub-pixel in sub-pixel rendering are determined. 

FIG. 4 is a flowchart of the steps performed by a method for 
determining a mask coefficient of a scaling filter. 
15 In step 401, the resolution ratio between the input image and the 

display apparatus is calculated. 

Then, in step 402, the number of masks of the scaling filter is 
determined. 

In step 403, the coefficient of each mask is determined. 

20 In the step 402, the cycle of alternation between apparatuses is 

determined by the resolution ratio obtained in the step 401 , and the number of 
masks that can appear in one cycle in the vertical direction and in the horizontal 
direction is obtained by the cycle of alternation between a pixel of the input 
image and a sub-pixel on the delta-structured display in the horizontal direction 

25 and in the vertical direction. 

In the step 403, mask coefficients are defined for each of masks 
determined in the step 402. At this time, the shape of a mask defined by the 
scaling filter may be the same shape as one pixel of the existing display 
apparatus as shown in FIG. 5, or may be expressed as a rhombus shape which 

30 considers the characteristic of a modulation transfer function (MTF) of human 
eyesight which is sensitive to a vertical and horizontal contrast, and can 
consider the vertical and horizontal areas more than the area in the diagonal 
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direction. In particular, since the delta-structured sub-pixels cause more color 
fringes in a straight line boundary in the vertical direction, the value of an input 
pixel in the horizontal direction should have a bigger weighted value in 
determining sub-pixel values than that in the vertical direction. Accordingly, the 

5 mask shape of the scaling filter which determines the value of a sub-pixel 
appropriate to the delta structure is a rhombus shape in which the horizontal 
axis is longer than the vertical axis as expressed by solid lines in FIG. 6. At this 
time, the coefficient of the generated rhombus-shaped mask may be 
determined in proportion to an area overlapping the pixel of the input image. 

10 Here, in order to render a color on an accurate location, the centroid of a mask 
for rendering a sub-pixel should always correspond to the center of the sub- 
pixel. 

In the step 302, a consideration area for an area in which a 
corresponding output sub-pixel overlaps the input image is determined. 
15 Through a mask operation with input pixels included in a consideration area, a 
representative value indicating an output sub-pixel is obtained by the following 
equation 1 : 

Mi = Y,C nk Vi k (1) 

k 

20 

The equation 1 expresses k input pixels (Vi k ) corresponding to an 
arbitrary output sub-pixel in the form of products with coefficients (C n k) of the n- 
th scaling filter. The equation 1 is designed to give a weighted value 
considering the distance from the central location of an output sub-pixel, to the 

25 values of corresponding input pixels in order to obtain a representative value of 
each output sub-pixel. 

In the step 303, in order to reduce blurring due to lowering of resolution, 
an improved output sub-pixel value is obtained by considering the differences 
between input pixels included in the consideration area and representative 

30 value expressing an output sub-pixel value, and this can be expressed as the 
following equation 2: 
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Vo'^C^Vi.+aD,*-^-) (2) 

k Vl hiAX 

D k =Mi-Vi k (3) 

5 The equation 2 expresses an arbitrary sub-pixel value (Vo') by using the 

product of k input pixels (Vi k ) by corresponding scaling filter coefficients, and the 
product of input pixels (Vi k ) by a value considering the difference (D k ) between 
the representative value (Mi) of an output sub-pixel obtained in the step 2 
expressed by the equation 3 and neighboring pixels (Vi k ) in the corresponding 

10 area. Here, since the weighted value considering a corresponding input pixel 
increases in proportion to the difference with neighboring pixels, blurring caused 
by lowering of resolution can be reduced even in an image including a boundary 
in which the difference of values is great. 

In the step 304, gamma correction appropriate to a display apparatus, 

15 on which the value of a sub-pixel is displayed, is performed. In general, an 
image display apparatus has a gamma characteristic of a value between 2.0 
and 2.4. Accordingly, in order to render color information of an arbitrary input 
image in a color appropriate to a display apparatus, the gamma characteristic of 
the display apparatus, on which the image is desired to be displayed, should be 

20 corrected for individual components of each sub-pixel. Through this process, 
the distribution of values of sub-pixels rendered on the display can be a linear 
distribution. At this time, gamma correction of the display apparatus for the 
value (Vo') of an input sub-pixel is expressed as the following equation 4: 

25 Vo = Vo^{^-Y (4) 

The equation 4 shows performing gamma correction ( — ) in order to 

r 

make the value (Vo') of a sub-pixel, which is obtained in the step 303 and is to 
be rendered on a display, an accurate color value on the display apparatus, that 
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is, an output sub-pixel value (Vo). At this time, gamma (/) expressed in the 
equation 4 indicates a value which is measured for individual components of 
each sub-pixel. 

In the step 305, the output sub-pixel value (Vo) which is obtained in the 

5 step 304 and is to be displayed on the display apparatus is displayed. For this, 
by rendering each sub-pixel value on a variety of display apparatuses having a 
delta sub-pixel structure, an image with improved resolution can be displayed. 

FIG. 7 is a flowchart of the steps performed by a preferred embodiment 
of a method for rendering a color image on a display apparatus. In FIG. 7, the 

10 mask of a scaling filter using the ratio of the input image and the ratio of the 
display apparatus can be obtained by the steps of FIG. 4, and the defined mask 
is sequentially applied in order of the sub-pixel line of the display apparatus. 
Also, rendering of sub-pixels of the display apparatus using an input image can 
be obtained by equations 1 through 4. 

is The process will now be explained in order. First, image data are input 

in step 701. Then, it is determined whether or not a sub-pixel line to be 
calculated is a new sub-pixel line in step 702. If the line is a new sub-pixel line, 
a scaling filter is formed in step 703. Then, input pixel values in a rhombus- 
shaped processing area (consideration area) are read and the representative 

20 value of a sub-pixel is obtained in step 704. Next, a sub-pixel value 
considering the difference between corresponding pixels of the image data is 
obtained in step 705. Then, gamma correction appropriate to a display 
apparatus on which the sub-pixel value is rendered is carried out in step 706. 
The sub-pixel value is displayed on the display apparatus in step 707. If the 

25 determination result of the step 702 indicates that the line of a next output sub- 
pixel is not a new sub-pixel line, the step 704 is performed. 

FIG. 8 is a block diagram of the structure of a preferred embodiment of 
an apparatus for rendering a color image on a delta-structured display 
apparatus according to the present invention. The apparatus comprises a 

30 scaling filter forming unit 801, an output sub-pixel representative value 
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measuring unit 802, a sub-pixel value adjusting unit 803, a gamma adjusting 
unit 804, and a rendering unit 805. 

The scaling filter forming unit 801 forms a scaling filter which is used to 
make the resolution of an input image that is the image of an input signal 
correspond to the resolution of a display apparatus. 

The sub-pixel representative value measuring unit 802 obtains the 
representative value of a sub-pixel of the display apparatus corresponding to a 
consideration area which is an area processed by the scaling filter in the input 
image. 

The sub-pixel value adjusting unit 803 obtains the value of the sub-pixel 
based on the difference between pixels of the consideration area in the input 
image. 

The gamma correction unit 804 performs gamma correction of the value 
of the sub-pixel so that the value of the sub-pixel is appropriate to the display 
apparatus. 

The rendering unit 805 renders the value of the gamma-adjusted sub- 
pixel value on the display apparatus. 

The present invention may be embodied in a code, which can be read 
by a computer, on a computer readable recording medium. The computer 
readable recording medium includes all kinds of recording apparatuses on 
which computer readable data are stored. 

The computer readable recording media includes storage media such 
as magnetic storage media (e.g., ROM's, floppy disks, hard disks, etc.), optically 
readable media (e.g., CD-ROMs, DVDs, etc.) and carrier waves (e.g., 
transmissions over the Internet). 

Optimum embodiments have been explained above and are shown. 
However, the present invention is not limited to the preferred embodiment 
described above, and it is apparent that variations and modifications by those 
skilled in the art can be effected within the spirit and scope of the present 
invention defined in the appended claims. Therefore, the scope of the present 
invention is not determined by the above description but by the accompanying 
claims. 
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According to the present invention, by using the sub-pixel rendering 
method of a display apparatus, resolution is improved and the color fringe that 
can occur due to sub-pixel rendering is reduced. Also, the method and 
apparatus for rendering a color image on a delta-structured display has a scaler 

5 function, by which an input image of a high resolution can be displayed on a 
display apparatus having a low resolution, and renders sub-pixels of the display 
apparatus such that the resulting resolution is better than the actual resolution 
of the display apparatus and the color fringe appearing in a delta sub-pixel 
structure is efficiently reduced. In addition, by doing gamma adjustment for 

10 rendering accurate colors of the display, a more accurate image can be 
reproduced. 
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